CLASSY 2009: Summarization and Metrics

This year the CLASSY team participated in the update summary task and made four submissions to summarization evaluation (AESOP). Our AESOP submissions used combinations of ROUGE scores along with an update (or newness) score. We also use these new metrics, which we call Nouveau ROUGE, to help train our system and evaluate new ideas on computing update summaries. CLASSY (Clustering, Linguistics, and Statistics for Summarization Yield) is the summarization system developed mainly1 by IDA/Center for Computing Sciences. Before describing the Nouveau ROUGE update metrics, we describe improvements made to CLASSY in data preparation, redundancy removal, and sentence selection.